Universal channel coding for general output alphabet

نویسنده

  • Masahito Hayashi
چکیده

We propose a universal channel coding when each output distribution forms an exponential family even in a continuous output system. We propose two types of universal codes; One has the exponentially decreasing error with explicit a lower bound for the error exponent. The other attains the ǫ-capacity up to the second order. Our encoder is the same as the previous paper [CMP 289, 1087]. For our decoding process, we invent α-Rényi divergence version of Clarke and Barron’s formula for Bayesian average distribution, which are not required in the previous paper. Combing this formula and the information spectrum method, we propose our universal decoder. Our method enables us to treat a universal code of the continuous and discrete cases in a unified way with the second order coding rate as well as with the exponential decreasing rate. Index Terms Universal coding; information spectrum; Bayesian; type method

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Upgraded Approximation of Non-Binary Alphabets for Polar Code Construction

An algorithm is presented for approximating a single-user channel with a prime input alphabet size. The result is an upgraded version of the channel with a reduced output alphabet size. It is shown that this algorithm can be used to reduce the output alphabet size to the input alphabet size in most cases.

متن کامل

An information-spectrum approach to joint source-channel coding

Given a general source V = fV gn=1 with countably in nite source alphabet and a general channel W = fW ng1 n=1 with arbitrary abstract channel input and output alphabets, we study the joint source-channel coding problem from the information-spectrum point of view. First, we generalize Feinstein's lemma (direct part) and Verd u-Han's lemma (converse part) so as to be applicable to the general jo...

متن کامل

Analogy and duality between random channel coding and lossy source coding

Here we write in a unified fashion (using “R(P,Q,D)” [1]) the random coding exponents in channel coding and lossy source coding. We derive their explicit forms and show, that, for a given random codebook distribution Q, the channel decoding error exponent can be viewed as an encoding success exponent in lossy source coding, and the channel correct-decoding exponent can be viewed as an encoding ...

متن کامل

Distributed detection and coding in information networks

This thesis investigates the distributed information and detection of a binary source through a parallel system of relays. Each relay observes the source output through a noisy channel, and the channel outputs are independent conditional on the source input. The relays forward limited information through a noiseless link to the final destination which makes an optimal decision. The essence of t...

متن کامل

IRWIN AND JOAN JACOBS CENTER FOR COMMUNICATION AND INFORMATION TECHNOLOGIES Reliability of Universal Decoding Based on Vector- Quantized Codewords

Motivated by applications of biometric identification and content identification systems, we consider the problem of random coding for channels, where each codeword undergoes lossy compression (vector quantization), and where the decoder bases its decision only on the compressed codewords and the channel output, which is in turn, the channel’s response to the transmission of an original codewor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015